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METHOD AND SYSTEM FOR STEGANOGRAPHICALLY EMBEDDING 
INFORMATION BITS IN SOURCE SIGNALS 

This invention relates to a method and system for embedding information 
5 , bits in a host signal. The embeddmg may be performed to determine origin of any 
perfect or imperfect copies of the composite (host plus message) signal, or to use 
the host signal as a cover for secret or covert communications, over a channel 
which is primarily meant for transmitting the host signal only. 

10 BACKGROUND OF THE INVENTION 

Data hiding or steganography is the art of hiding a message signal in a host 
signal, without any perceptual distortion of the host signal. The composite (host 
plus message) signal is also referred to as stego-signal. Though steganography is 
often confused with the relatively well-known cryptography, the two are but 
15 loosely related. Cryptography is about hiding the contents of a message. 
Steganography, on the other hand, is about concealing the very fact that a message 
is hidden. Steganography may be considered as communication through 
subliminal channels, or secret communication. 

20 Rapid increases in bandwidth available for dissemination and storage of 

digital content and availability of software tools for editing multimedia content, 
such as, video, images or audio calls for systems and methods to establish origin of 
such content. In addition, large volumes of multimedia content being exchanged 
over insecure channels, such as, the Intemet, provide within themselves secure and 

25 subliminal steganographic channels for secure or secret communications. 



The proliferation of digital multimedia as opposed to conventional analog 
forms, is primarily a result of (1) the ease with which digital data can be exchanged 
over the Internet, and (2) the emergence of efficient multimedia data compression 
30 techniques. 

The &st reason listed above is also a major cause for concern. Unlimited 
perfect copies of the original content can be made, and distributed easily. It was 
this concem of protecting intellectual property rights of multimedia data in digital 
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form, that primarily triggered researchers to find ways to watermark multimedia 
data. Watermarking the content is done by embedding some data in the host signal 
(original content). The embedded data may be an imperceptible signature, which 
the owner of the multimedia content should be able to extract when a dispute 

5 regarding ownership occurs. 

Data hiding in multimedia could help in providing proof of origin and 
distribution of content. Multimedia content providers would be able to 
communicate with the compliant multimedia players (or Tenderers) through the 
10 subliminal, steganographic channel. This communication may control or restrict 
access of multimedia content, and carry out e^commerce for pay-per-use 
implementations. 

A typical application of data hiding for multimedia content delivery may 
15 involve the content providers supplying the raw multimedia data (say a full length 
movie) along with some hidden agents or control data . The job of the distributors 
would be to package the content in some suitable format (such as, MPEG) 
understandable by the player, for distribution of the multimedia through 
DVDs/CDs or live digital broadcasts, or by hosting web sites for downloads or 
20 streaming. The compliant multimedia players, mil typically be connected to the 
Internet. 

In conventional multimedia distribution, the content provider looses all 
control over how the multimedia is used/abused the moment it is acquired by 
25 another party. The key idea behind data hiding is to re-establish control whenever 
the content is used. The content provider, by hiding an agent in his raw data, hopes 
to control access to his/her multimedia content. This can be done with the co- 
operation of the players, and an established protocol for communication between 
the content providers and the compliant multimedia players. 

30 

Data hiding can be broadly classified into two categories depending on 
whether the original content is needed for extraction of the hidden bits: (1) non- 
oblivious metbods need the original content for extracting the hidden bits; and (2) 

2 
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on the other hand, oblivious detection methods extract the hidden bits without any 
knowledge of the original. 



In most data hiding methods, sequence of bits to be embedded, viz. B, is 
5 converted to a form suitable for embedding in a cover content. Initially, the bit 
sequence is converted to a signature sequence. Thereafter, the signature sequence 
is embedded in the cover content by m embedding function to obtain the stego- 
content. 

10 From a signal processing perspective; data hiding methods can be classified 

into two categories, depending on the type of embedding and detecting operators. 
The first category includes methods where the embedding function adds the 
signature sequence linearly to stego-content, and the detector detects fi-om the 
stego-content via correlative processing (these methods are referred to as Type I 

15 methods in data hiding literature). In the second category the embedding function 
and the detector are non-linear, typically employing quantizers (these methods are 
referred to as Type U methods in data hiding literature). One of the important 
characteristics of the non-linear methods is their ability to suppress the noise due to 
the original content (or self-noise), even though the original content is not available 

20 at the receiver. 

The present invention provides a unique data hiding technique that 
substantially reduces the effect that noise, distortion or corruption of the host signal 
have on the detected signal so as to greatly enhance the integrity of steganography 
25 techniques employing oblivious detection of the hidden data. The crux of the 
invention is a class of methods referred to as Type III methods of which Types I 
and n are just special cases. An optimal choice of parameters for the proposed 
Type III methods depending on the engineering constraints, can substantially 
improve the performance of data hiding. 

30 

The present invention also provides many additional advantages, which 
shall become apparent as described below. 



3 
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SUMMARY OF THE INVENTION 

A method for embedding a message signal in a host signal, the method 
comprising the steps of: 
5 (a) embedding the message signal into the host signal, thereby producing 

a stego signal; and 

(b) detecting an estimate of the message signal JBrom the stego signal; 
provided that the detecting step (b) is not an exact inverse of the 
embedding step (a), and the host signal camot be exactly extracted 
1 0 from the stego signal. 

The embedding step (a) produces a value in the stego signal from a 
value in the host signal, and w^herein the embedding step (a) comprises limiting 

to a limit value ~ , a magnitude of difference between and a, . 

15 

Furthermore, the embedding step (a) employs a continuous periodic 
function to produce the stego signal, and wherein the detecting step (b) employs a 
continuous periodic function to produce the estimated message signal. The 
continuous periodic function is a triangular ftmction f{x) having a period A, 
20 wherein: 

-4^/W<4foraUx; 
4 4 

/(0) = -|; and 

•^^2 4 



Optionally, the embedding step (a) produces a value b^ in the stego signal 
25 from a value a,, in the host signal and a value in the message signal, such that 

the embedding step (a): 

(i) is subject to a maximum distortion constraint P, 

(ii) employs a continuous periodic function having a period A , and 

4 
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(iii) is represented by the function b^- Eia^.s^), and employs an 
algorithm as follows: 

if rem(—) > — , then D: = 3 — - rem(—) , 

else =rem(^)-^; 

A 4 

5 e^^s^-pr, 

if (I \> y) > then e, = Jzgn(e,)|- ; 

qi=rem{'f); 
A 

if 9,. > Y^then =-e,.; 

if > 0 , then b^^a^^- , 
10 else =at; -e^. 

The method of the present invention is particularly useful when the stego 
signal is corrupted or distorted prior to detecting step (b). In this embodiment 
where the stego signal is corrupted a value b^ in the stego signal is modified after 

15 the embedding step (a) to yield a value in the corrupted or distorted stego 
signal, such that the detecting step (b): 

(i) produces a value in the estimated message signal from a value 
c,. in a distorted stego signal, 
20 (ii) employs a continuous periodic function having a period A , and 

(iii) is represented by the function s^i~D{c.)^ and employs an 
algorithm as follows: 

q,^rem{-j-)\ 
A 

25 else =9^-4- 

4 
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Preferably the host signal is a sequence a^., for i = 1 to ; the message 
signal is a sequence , for z = 1 to N; the stego signal is a sequence , for 
f = l to AT; the corrupted or distorted stego signal is a sequence c^, for 
5 / = 1 to N; and the estimated message signal is a sequence s^^^ for 
f = l to A^. 

The embedding step (a) preferably (i) imposes a limit on a magnitude 

difference between a value in the stego signal that is produced from a value 
10 in the host signal; and (ii) employs a continuous periodic function having a period 

A to produce the stego signal, wherein such the limit and the period A are 

chosen to minimize a mean square distance between the message signal and the 
estimated message signal, subject to a maximum distortion constraint P of the 
embedding step (a). 

15 

The present invention also provides a method for mapping K information 
bits to a message signal ^ . , / = 1 to N . This method comprising the step of: 

grouping the K information bits together to represent one of 2^ symbols, wherein 
each of the 2^ symbol is mapped to a basis vector or its negative of a 2^"' x 2^"^ 
20 orthogonal transfomi matrix. The orthogonal transform matrix is obtained from a 
cyclic* all-pass filter and its circular shifts. The cyclic all-pass filter is preferably 
obtained from a key. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of the data embedding, channel and detection 
operation according to the present invention; 

Fig. 2 is a graph depicting a periodic triangular function employed by the 
30 detector D of Fig. 1; 
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Fig. 3(a) is a graph demonstrating that the distortion introduced during the 
embedding the 5 in ^ (to obtain 5 ) of Fig. 1 in accordance Avith Type n will be 

uniformly distributed between - — and + — ; 
^ 2 2 

5 

Fig. 3(b) is a graph depicting the distribution of the distortion introduced in 
accordance with the method of the present invention; and 

Fig. 3(c) is a graph depicting the distribution of the limiting noise . 

10 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

The present invention is a method for efficient secure communication over 
subliminal channels provided by multimedia host signals like audio, ^images and 
15 video transmitted over any channel. For example, the host signal may be 
transmitted over the Internet or distributed in storage mediums by other means or 
even transmitted over analog channels, such as, that used for analog television or 
radio broadcasts. Typically the host signal is expected to undergo some distortion 
before it reaches one or many end points where it may be stored or rendered. 

20 

In the method described herein, the host signal may be any form of 
naturally occurring signals, such as, audio, image or video or artiJBcially 
synthesized versions of them. The host signal may further be represented in some 
transform domain. The choice of the transform may depend on the nature of the 

25 application. For example, if the host signal is an image and is not expected to be 
re-scaled, resized or rotated, any unitary transform may be used. On the other hand, 
if the image is likely to undergo rotation, scaling and/or translation, a Rotation- 
Scale-Translation invariant transform may be lised. If the image is cropped, data 
embedding may be performed in many blocks of the image, so that the hidden bits 

30 can be extracted even if one such block survives. In general, the host signal can be 
coeflBcients of a one-to-one transform or a many-to-one transform. 
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In the method described herein, the host signal can therefore be considered 
as a vector or a sequence of N real or complex numbers, represented by 
A = [a^ Qj ••• o^]. 

5 A sequence of K bits, represented by 

is mapped by a mapping JW to a signature sequence S , . 
jl/:/->'iS', where 
S = [Si •■■ s^] 

10 

An embedder£ embeds the sequence iaA to obtain the stego sequence B, 
B = E(A,S), where 

B = [b, - b„], 
the embedding being performed element-wise, 
=£:(fl„j,) 

15 b^=E(a^,S3) 
b^=Eia^,s^) 

subject to the constraint that d{A,B) < P where d{A,B) is some distance measure 
of signals A and B , and P is the maximum permitted distortion of the host 
signal. In the preferred embodiment the distance measure is the mean square error: 

N 

20 

The stego sequence B may undergo some distortion before it reaches the 
detector as C , given by C = B+Z , where 

Z = [z, ••• z„], 
is the noise in the channel used for transmitting the host signal, and 
25 C = [c, Cj ••• 
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The detector D obtains an estimate of the signature sequence S 

embedded: 



5 The block diagram of data embedding, the channel and detection operation 

is shown in FIGURE I. 

Based on this generalization of the embedding and detecting functions E 
and D , prior art in this field can be categorized into two types. 

10 

Characteristics of Type I 

• B^E{A,S)'^B = A + S 

• D{B) = A^S^S 

The above two equations imply that E and D are not inverses. 
15 In addition, if 5 is known one can obtain the original host sequence 
A bom B as A^B-S. 

Characteristics of Type II 

• B = EiA,S) 
20 • D(B) = S 

Unlike Type I methods, the above two equations show that for Type n 
methods E and D are exact inverses. Additionally, unlike Type I methods, it is 
not possible to obtain A exactly, given B and S . 

25 

In the core of this iayention is a class of embedding and detection operators 
E and D , we shall refer to as Type in. 



Characteristics of Type III 
30 • B = E(A,S) 

• DiB) ^ S 
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The above two equations illustrate that E and D are not exact inverses (like Type 
I and unlike Type II). Further, given S and B it is not possible to obtain A Qike 
Type n and unlike Type I). 

5 In a preferred embodiment described herein, the detector D , where 

is implemented by the following algorithm: 

if >|then J,, =3^-9^., 

10 else ^qi-~^ 

In the above algorithm, rem (x) stands for the remainder of a division operation 
(x), For example, 

rem(5/4)=l, rem(2/2)=0, rem(-6/4)=rem(6/4)=2. 

15 The choice of the parameter A is dictated by the distortion constraint P and the 
energy of the channel noise Z . The detector may also be thought of as employing 
a periodic triangular function shown in FIGURE 2, 

y- f{x)- f(x + mA) for integer m . Also, 

-^<f(^x)<- for all X, 
4 4 



20 and specifically, 



/(0) = -f 



The embedding operation =E(ai,s,) is implemented by the following 
algorithm: 

25 if remi^) > - , then = 3 — - remfy , 

A 2 4 A 
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else p,=remfy-^; 

A 4 

if (I |> . then e, = sign(e,)^ ; 

if rem(—) > — , then e, = -e, : 
A 2 

5 if at, > 0 , then bi^Oi+e,, 

else 6, = a, - e, . 



In the above algorithm, y0 is a parameter, the choice of which is dictated 
by the distortion constraint P and the energy of the channel noise Z . Also sign 
10 (x) equals +1 if the quantity 'x' is positive and sign (x) equals -1 if the quantity 'x' 
is negative. For example, 

sign(-20) = sign(-l) = -I, and sign(l 1) = sign(l) = +1 . 

As an example of the embedding and detection operations, let 
15 A=[-65, -250, 19, 43, -172, 179, 178, -6], and 

S=[10, 10, -10, 10, -10, 10, -10, 10], 

A = 40,and B = \Q (Note that -—<s.<— for alii). 

^ 4 ' 4 ' 

Now B = E{A,S) is given by 

B=[-60,-255, 14, 48,-167, 180, 173,-11]. Let 

20 Z=[-4, -8, 2, -10, -5, 3, -6, -4]. Therefore, 

C=B+Z=[-64, -263, 16, 38, -172, 183, 167, -15], and 

S, = D(C) is now 

5. =[6.7.6,-8,2,7,-3,5]. 
Now let us consider 6, - E(a, . ) , for i=l . a, = -65, = 1 0 . 

25 If remi^) > - , then = 3 - - rem(^) , 

A 2 ^'4 ^A 



rem{=^) = 25 > ^ , = 30 - 25 = 5 



11 



wo 02/13436 PCT/USOl/24468 
else Pi = rem(—) - — 

^i~^i~Pi = 10 - 5 = 5 

if (1 ^/ i> . then = sign{e,)^ e,=^ 

if rew(^) > 1^ e, = ^e, remi^) = 25>^,e^=-5 

5 if a,. > 0 bi=a^+e^ 

else &^ =a. -e,. 6j = -65 - (-5) = -60 



Now Cj = ftj + = -60 - 4 = -64 . For detection, 

10 ^ ^ f '^^^ -^f 9i = 24 > 20, = 30-24 = 6 

else s,, =?/-^ 



For Type 11 systems {A = fi) the distortion introduced, viz. B-A for 
embedding the S in ^ (to obtain 5 ) will be uniformly distributed between - ^ 

15 and +— (FIGURE 3a), and the average energy of the distortion introduced in A 

will be ^ . For Type IE systems, the distribution of the distortion introduced is 

depicted in FIG. 3b. The average energy of the distortion for a Type III system is 
given by 

12A 

20 While for Type II systems s, = D(b, ) , for the proposed Type IH system 
D{b,)-s,=t, 
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where is noise due to "limitiBg" (limiting occurs when j3 <A), The distribution 

of the limiting noise is shown in FIG. 3c, and the average energy of the limiting 
noise is given by 

12A 

5 

Optimal choice of the parameters A and fi for a given signal-to-noise ratio 

(snr) 

- Signal Energy ^ 12A 

Noise Energy Energy of Channel Noise Z 

is shown in Table 1. In Table 1, 

10 

SNR = lOlogjo (snr) dB, and 




From the values of A and signal energy ? , yff can be obtained by solving 
12A 

Table 1 - Optimal Choice of k for different SNRs 



SNR 


k 


4.77 


1.24 


3.01 


1.40 


1.76 


1.55 


0.00 


1.87 


-3.01 


2.57 


-4.77 


3.14 


-6.02 


3.59 


-6.99 


4.04 


-7.78 


4.40 


-8.45 


4.78 
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-9.03 


5.11 


-9.54 


5.41 


-10.00 


5.71 


-13.01 


8.10 


-14.77 


9.95 



The optimal parameters are chosen to mininaize 

which is the normalized mean square distance between the embedded signature 
5 sequence and the detected signature sequence. The minimization performed under 
the assumption that the channel noise Z has a Gaussian distribution. If Z is zero 
mean and has a variance of cr^ , then 

,2 



10 



where 



, 1 ^ fT( i2i+m 



p 



and 

erf(0 = - fe ^ dy 



+ — i 
2A 



erf 



z + 



A-fi 



-erf 



z — 



J) 



The mapping 
15 M:I-^S, 

in the preferred embodiment takes the following form. The bit sequence I of K bits 
is grouped mto K/L L-bit symbols. Each L-bit symbol will be mapped to one of in 



2 basis vectors of an orthogonal transform. Thus we can embed 



NL 

symbols or -^p^ bits in the sequence A. For example. 



N_ 



20 if N=8192, for 



L = 2,3,4,5, 6, 7, 8, 9, and 10, 

14 
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K = 8192, 6144, 4096, 2560, 1536, 896, 512, 288, and 160 bits 
respectively. 



In the preferred embodiment, L bits corresponding to each symbol are 
5 assiuned to represent a decimal number between 1 and 2^"' . This number is used 
as the index of the basis vector to be chosen. 

The basis vectors of a QxQ orthogonal transform where g = 2^'* are 
obtained from a random seed as follows. The random seed (or key) is used to 
10 generate uniformly distributed random sequence 

The random numbers define the phase of the discrete Fourier 

transform (DFT) of a sequence H. The magnitudes of the discrete Fourier 
15 coefficients are assumed to be imity. Such a sequence H is cyclic all-pass of length 
Q. H is orthogonal to all its cyclic shifts. Such a sequence derived from a random 
seed and all its cyclic shifts form a complete basis, and can therefore be considered 
as the basis vectors of a Q>^Q unitary transform matrix. 



20 As an example, let 0=8. Let the — - 1 =3 random numbers be 

2 

[-2.7489, -0.7854, 1.1781]. 
These random numbers describe are the angles of the Discrete Fourier Transfomi 
coefficients of H. The angles of the 8 coefficients of H are 

[0, -2.7489, "-0.7854, 1.1781, 0, -1.1781, 0.7584, 2.7489] 
25 and thek magnitudes are equal to 1. The cyclic all-pass filter H is obtained by 
inverse Discrete Fourier Transform as 

[0.2915, -0.1499, 0.3999, -0.0415, 0.5621, 0.5034, ^.2534, - 

0.3121] 



30 Each segment of length Q of the signature sequence S of length N 

carries information pertaining to one symbol between 0 and 2Q-1. 

15 
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Symbol sequence - [y^, y^, • • • , j/j^ ] ; 0 ^ j/,. £ 2g - 1 for all i 

Signature sequence - [i?!, ^^A-^ 

Q 

5 The algorithm for obtaining tiie signature sequence is as follows 

for alii 
sign=l; 

if h^Q 
shift=j;,-e; 

10 sign = -l; 

else 
shift - 

circularshift (sign x shift); 

15 For example, if 

H= [0.2915, -0.1499, 0.3999,-0.0415, 0.5621, 0.5034,-0.2534,-0.3121] 
and y^ = 2 (circular shift by 2) then, 

= [-0.2534, -0.3121, 0.2915, -0.1499, 0.3999, -0.0415, 0.5621, 
0.5034]. 

20 

As an other example, if = 10 (circular shift by 10-8=2 followed by 
negation), then 

= [0.2534, 0.3121, -0.2915, 0.1499, -0.3999, 0.0415, -0.5621, 
-0.5034]. 

25 

The Algorithm for the inverse mapping : 5^ is as follows: 
Each segment of length Q of the detected sequence = [5^1 , 5*^2 , - • ,S j^] 

corresponds to a symbol The embedded symbol is estimated as follows: 
HH=DFT(U) 

16 
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for all i 
SS=DFT(5,,); 
YY=IDFT(SS.*HH); 
=index(inax(abs(YY))); 
5 if(YY[3;J)<0,then 



In the above algorithm, DFT stands for Discrete Fourier Transform and 
DDFT stands for Inverse DFT. y^^ is the estimate of j;,, which is the symbol 

1 0 embedded in the i*th segjnent of S, Finally, the binary representation of e y^^ yields 

the corresponding sequence of bits /^^ , and 

e — 

Q 

/g is the estimate of the hidden bit sequence 1. 
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1. A method for embedding a message signal in a host signal, said method 
comprising the steps of: 

5 (a) embedding said message signal into said host signal, thereby producing 

a stego signal; and 

(b) detecting an estimate of said message signal from said stego signal; 
provided that said detecting step (b) is not an exact inverse of said 
embedding step (a), and said host signal cannot be exactly extracted 
10 from said stego signal. 

2. The method according to claim 1, wherein said stego signal is corrupted or 
distorted prior to detecting step (b). 

15 3. The method according to claim 1, wherein said embedding step (a) produces a 
value in said stego signal fix)m a vsdue in said host signal, and wherein 

R 

said embedding step (a) comprises limiting to a limit value y , a magnitude of 
difference between and a, . 

I 4. The method according to claim 1, wherein said embedding step (a) employs a 
continuous periodic function to produce said stego signal, and wherein said 
detecting step (b) employs said continuous periodic function to produce said 
estimated message signal. 

5. The method according to claim 4, wherein said continuous periodic function is 
a triangular function. 

6. The method according to claim 5, wherein said triangular function f{x) has a 
period A, and 

wherein: 

-4^/(x)<4foraUx; 
4 4 

18 
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/(0) = -|; and 



7. The method according to claim 1 , wherein said embedding step (a) produces a 
value in the said stego signal from a value in said host signal and a value 

5 5, in said message signal, such that said embedding step (a): 

(i) is subject to a maximum distortion constraint P, 

(ii) employs a continuo\is periodic function having period A , and 

(iii) is represented by the function = E{a^^s^)^ and employs an algorithm 
as follows: 

1 0 if rem(—) > — . then p. =3—- rem(—) , 

^A^ 2 ^' 4 ^A^ 

else Pi^remfy-^; 

A 4 

if (I !> ~) . then = sign(e,)^; 
A 

15 if > y , then = -e^ ; 

if > 0 , then ^a^-^-e^; 
else bf-a^-e^. 

8. The method according to claim 2, wherein a value in said stego signal is 
20 modified after said embedding step (a) to yield a value in said corrupted or 

distorted stego signal, and wherein said detecting step (b): 

(i) produces a value jg, in said estimated message signal from a value in 
said distorted stego signal, 

(ii) employs a continuous periodic function having a period A , and 



19 



wo 02/13436 PCTAJSOl/24468 
(iii) is represented by the fimction s^^ = D(Cf) , and employs an algorithm 
as follows: 

q,^rem{—); 

if g,>|,then ^^.=3^-?,, 
5 else5,, 

4 

9. The method according to claim 2, wherein 

said host signal is a sequence , for z = 1 to N; 
said message signal is a sequence , for / = 1 to N; 
1 0 said stego signal is a sequence , for f = 1 to N ; 

said corrupted or distorted stego signal is a sequence c- , for z = 1 to A'^ ; 
and 

said estimated message signal is a sequence s^^, for z = 1 to A'' 

15 10. The method according to claim 1, wherem said embedding step (a): 

(i) imposes a limit on a magnitude difference between a value 6, in 

said stego signal that is produced from a value a, in said host 
signal; 

(ii) employs a continuous periodic function having a period A to 
20 produce said stego signal, wherein such said limit ^ and said period A are 

chosen to minimize a mean square distance between said message signal 
and said estimated message signal, subject to a maximum distortion 
constraint P of said embedding step (a), 

25 11. A method for mapping K information bits to a message signal Sf, 
i = 1 to N , said method comprising the steps of: 
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grouping said K information bits together to represent one of 2^ symbols, 
wherein each said 2^ symbol is mapped to a basis vector or its negative of a 
2^"* X 2^"^ orthogonal transform matrix. 



5 12. The method according to claim 11, wherein said orthogonal transform matrix 
is obtained from a cyclic all-pass filter and its ciruclar shifts. 

13. The method according to claim 12, wherein said cyclic all-pass filter is 
obtained from a key. 

10 
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